Display-data processor including first and second buffers and timing generator that variably outputs horizontal synchronization signal

ABSTRACT

A display-data processor includes a first buffer, a display data generator, a second buffer, a timing signal generator, and a display data output circuit. The first buffer stores image data corresponding to an Nth line of a display. The display data generator generates display data corresponding to the Nth line of the display based on the image data. The second buffer stores the display data corresponding to the Nth line of the display. The timing signal generator outputs a horizontal synchronization signal corresponding to the Nth line of the display after the display data had been generated. The display data output circuit outputs the display data corresponding to the Nth line of the display within a horizontal synchronization period prescribed by the horizontal synchronization signal corresponding to the Nth line of the display after the horizontal synchronization signal corresponding to the Nth line of the display had been outputted. The horizontal synchronization period is variable.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a continuation application of U.S. patent application Ser. No.15/061,467 filed on Mar. 4, 2016, which is a continuation application ofU.S. patent application Ser. No. 14/467,800 filed on Aug. 25, 2014, nowU.S. Pat. No. 9,319,592, which is a continuation application of U.S.patent application Ser. No. 13/161,917 filed on Jun. 16, 2011, now U.S.Pat. No. 8,830,342. This application claims priority to Japanese PatentApplication No. 2010-136847 filed on Jun. 16, 2010. The entiredisclosure of U.S. patent application Ser. Nos. 15/061,467, 14/467,800and 13/161,917 and Japanese Patent Application No. 2010-136847 arehereby incorporated herein by reference.

BACKGROUND Technical Field

The present invention relates to an image-capturing device fordisplaying an image of a subject in a display section, and to a timingcontrol circuit.

Related Art

Image-capturing devices adapted to display, on a liquid crystal display,images that have been captured by an image sensor are known in the past,and various techniques have been developed for preventing displayedimages displayed on a liquid crystal display from being delayed withrespect to the actual subject. In Patent Citation 1, for example, atechnique is disclosed whereby an image signal is read and displayed bya liquid crystal display before writing of the image signal of a singleframe to the VRAM is completed in an image-capturing device providedwith a VRAM for recording an image signal of a single frame.Specifically, a configuration is described in which image display by aliquid crystal display is started at a playback timing that is delayedby ΔT from the drive timing of the image sensor.

Japanese Patent Application Publication No. 2007-243615 (PatentCitation 1) is an example of the related art.

SUMMARY

In the technique of Patent Citation 1, the cycle of the drive timing andthe playback timing is the cycle for processing an image of a singleframe, and a constant ΔT is defined for each frame. In other words, inthe technique of Patent Citation 1, ΔT is described as being defined foreach mode (Patent Citation 1, paragraph 0057), and ΔT is determined sothat reading of image data does not take place before writing thereof(Patent Citation 1, paragraphs 0055 and 0056). Consequently, although ΔTmay fluctuate for each mode, ΔT is a common value for each frame in thesame mode, and the same phase difference ΔT is given for all lines ofthe image that is to be displayed.

However, in a configuration in which image processing is carried out forthe purpose of displaying an image of a subject in a display section onthe basis of image-capture data from an image sensor, because the periodneeded for image processing of various kinds differs for individuallines, the time needed for image processing of frames, which arecollections of lines, may differ for the individual frames in question.For example, in a live view mode whereby a moving picture is capturedand displayed, whereas it is desirable for the frame rate of the imagesensor to be as fast as possible, it is undesirable for image-capturedata to be imported from the image sensor under conditions in whichpreparations are not yet in order for carrying out processing togenerate the image data of the next frame (due to lengthening of theimage data generation process of the current frame). The reason is that,depending on the mode of the image-data-generation section, problemssuch as, for example, overwriting or destruction of image-capture dataof lines for which the image data generation process is yet uncompletedmay arise.

With the foregoing problem in view, it is an object of the invention tocontrol the timing for import of image-capture data from an imagesensor, doing so in accordance with current conditions.

A display-data processor according to one aspect includes a firstbuffer, a display data generator, a second buffer, a timing signalgenerator, and a display data output circuit. The first buffer storesimage data corresponding to an Nth line of a display. The display datagenerator generates display data corresponding to the Nth line of thedisplay based on the image data. The second buffer stores the displaydata corresponding to the Nth line of the display. The timing signalgenerator outputs a horizontal synchronization signal corresponding tothe Nth line of the display after the display data had been generated.The display data output circuit outputs the display data correspondingto the Nth line of the display within a horizontal synchronizationperiod prescribed by the horizontal synchronization signal correspondingto the Nth line of the display after the horizontal synchronizationsignal corresponding to the Nth line of the display had been outputted.The horizontal synchronization period is variable.

A method of processing a display-data according to one aspect includesstoring image data corresponding to an Nth line of a display in a firstbuffer, generating display data corresponding to the Nth line of thedisplay based on the image data, storing the display data correspondingto the Nth line of the display in a second buffer, outputting ahorizontal synchronization signal corresponding to the Nth line of thedisplay after the display data had been generated, and outputting thedisplay data from the second buffer to the display within a horizontalsynchronization period prescribed by the horizontal synchronizationsignal corresponding to the Nth line of the display after the horizontalsynchronization signal corresponding to the Nth line of the display hadbeen outputted. The horizontal synchronization period is variable.

BRIEF DESCRIPTION OF THE DRAWINGS

Referring now to the attached drawings which form a part of thisoriginal disclosure:

FIG. 1 is a block diagram according to an embodiment of the invention;

FIG. 2 is a view showing the number of pixels of the area image sensorand the liquid crystal panel;

FIG. 3 is a view showing an example of the method for outputting theimage-capturing of the area image sensor;

FIG. 4 is a timing chart showing the signals applied to the displaysection according to the present embodiment;

FIGS. 5A-5C are timing charts of signals applied to the area imagesensor according to the present embodiment;

FIG. 6 is a timing chart according to another embodiment of theinvention; and

FIG. 7 is a block diagram according to another embodiment of theinvention.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Embodiments of the invention will be described in the following order.

(1) Configuration of the image-capturing device

(2) Control of the horizontal synchronization signal

(3) Control of signals applied to the area image sensor

(4) Other embodiments

(1) Configuration of the Image-Capturing Device

FIG. 1 is an image-capturing device 1 according to one embodiment of theinvention. The image-capturing device 1 is provided with an opticalsystem 10, an area image sensor 15, an ASIC 200, a timing generator 30,a display section 40, a CPU 50, a VRAM 51, an SD-RAM 52, a ROM 53, a RAM54, and an operating section 55. The CPU 50 is capable of executing aprogram recorded in the ROM 53 by appropriately utilizing the VRAM 51,the SD-RAM 52, and the RAM 54, and through this program, the CPU 50executes a function for generating image data which indicate a subjectcaptured by the area image sensor 15, in accordance with an operation ofthe operating section 55. The operating section 55 is provided with ashutter button, a dial switch as a mode switching section for switchinga mode, a dial switch for switching an aperture and a shutter speed, anda push button for operating various types of setting menus, and a usercan issue various types of instructions to the image-capturing device 1by operating the operating section 55.

The display section 40 is an EVF (electronic view finder) for displayingan image indicating a subject to be captured and allowing the user tocomprehend the appearance of the subject prior to the capturing of theimage, and image-capturing conditions and other information, and theimage-capturing device 1 according to the present embodiment is amirrorless digital camera provided with an EVF. The display section 40is provided with an interface circuit not shown in the drawing, a liquidcrystal panel driver 41, a liquid crystal panel 42, and an eyepiece lensand other components not shown in the drawing. In the presentembodiment, the liquid crystal panel 42 is a high-temperaturepolysilicon TFT (Thin Film Transistor) provided with three sub-pixelscorresponding to three colors of color filters for each pixel, and thepositions of the pixels are prescribed by coordinates in an orthogonalcoordinate system. A line is composed of a plurality of pixels alignedin the direction parallel to one coordinate axis, and a plurality oflines is aligned in the direction parallel to the other coordinate axis.In the present specification, the direction parallel to the lines isreferred to as the horizontal direction, the direction perpendicular tothe lines is referred to as the vertical direction, and a single screencomposed of all the pixels of the liquid crystal panel 42 is referred toas a single frame.

The liquid crystal panel driver 41 applies a voltage to each sub-pixeland outputs a signal for driving the liquid crystals to the liquidcrystal panel 42. The liquid crystal panel 42 is provided with a gatedriver and a source driver not shown in the drawing, and performsdisplay by a process whereby the gate driver controls the display timingin each pixel of each line in accordance with the signal outputted fromthe liquid crystal panel driver 41, and the source driver applies avoltage that corresponds to the image data of each pixel to each pixelof a line designated by the display timing. In other words, the liquidcrystal panel driver 41 is configured so as to output various types ofsignals for performing display in the liquid crystal panel 42, e.g., avertical synchronization signal (DVsync) for prescribing a period fordisplay of a single frame; a horizontal synchronization signal (DHsync)for prescribing a period for display of a single line; a data activesignal (DDactive) for prescribing a period for importing image datawithin each line; a data clock signal (DDotclock) for prescribing theimport timing of image data of each pixel; and image data (Data) of eachpixel.

The image-capturing device 1 according to the present embodiment isprovided with the timing generator 30, and the vertical synchronizationsignal DVsync, the horizontal synchronization signal DHsync, the dataactive signal DDactive, and the data clock signal DDotclock aregenerated by the timing generator 30.

In other words, the timing generator 30 is provided with a displaycontrol section 30 b which is provided with a division circuit or thelike for generating a signal in which the signal level varies insynchrony with the variation timing of a clock signal having apredetermined cycle outputted from a clock signal generation section. Bycontrol of the display control section 30 b, the timing generator 30generates the vertical synchronization signal DVsync, data active signalDDactive, and data clock signal DDotclock in which the signal levelsvary at a timing determined in advance. The output timing of thehorizontal synchronization signal DHsync is variable in the presentembodiment, and the output timing is determined depending on theprocessing result of a resizing processing section 20 e, as describedhereinafter.

The liquid crystal panel 42 in the present embodiment is a panel havingan XGA-size pixel count provided with 1024 effective pixels in thehorizontal direction and 768 effective pixels in the vertical direction,and can display gradations corresponding to the Data in any position byadjusting the content and output timing of the image data Data outputtedby the liquid crystal panel driver 41. In the present embodiment, aconfiguration is adopted in which an image of the subject is displayedbased on the image-capture data of the area image sensor 15 in a subjectimage display region of the liquid crystal panel 42 determined inadvance, and characters indicating image-capturing conditions or otherinformation are displayed in a region outside the subject image displayregion. In other words, characters indicating image-capturing conditionsor other information are displayed as an OSD (on-screen display)together with the image of the subject in the liquid crystal panel 42.The liquid crystal panel 42 is provided with a large number of pixels inexcess of the effective pixels in the horizontal direction and thevertical direction, but in order to simplify the present specification,no description is given of the processing that relates to pixels otherthan the effective pixels.

The optical system 10 is provided with a lens 11 for forming a subjectimage on the area image sensor 15, and an aperture 12, a shutter 13, anda low-pass filter 14. Among these components, the lens 11 and theaperture 12 are replaceably attached to a chassis not shown in thedrawing. A CMOS (complementary metal oxide semiconductor) image sensor,CCD (charge coupled device) image sensor, or other solid image-capturingelement provided with color filters arranged in a Bayer array, and aplurality of photodiodes for accumulating a charge according to aquantity of light by photoelectric conversion for each pixel is used asthe area image sensor 15. The positions of the pixels of the area imagesensor 15 are prescribed by coordinates in an orthogonal coordinatesystem, wherein a line is composed of a plurality of pixels aligned inthe direction parallel to one coordinate axis, and a plurality of linesis aligned in the direction parallel to the other coordinate axis. Inthe present specification, the direction parallel to the lines isreferred to as the horizontal direction; the direction perpendicular tothe lines is referred to as the vertical direction. A single screencomposed of all the pixels of the area image sensor 15 is referred to asa single frame.

In the present embodiment, the area image sensor 15 also operates insynchrony with the various types of signals outputted by the timinggenerator 30. In other words, the timing generator 30 outputs a verticalsynchronization signal (SVsync) for prescribing a period for reading thedetection results of the photodiodes for a single frame; a horizontalsynchronization signal (SHsync) for prescribing a period for reading thedetection results of the photodiodes for a single line; and a data clocksignal (SDotclock) for prescribing the read timing and the like of imagedata of each pixel. The area image sensor 15 starts outputting theimage-capture data for a single frame in accordance with the verticalsynchronization signal SVsync, and sequentially reads image-capture datawhich indicate the detection results of the photodiodes corresponding toa portion of the pixels of the area image sensor 15 at a timing inaccordance with the data clock signal SDotclock within the periodprescribed by the horizontal synchronization signal SHsync.

The ASIC 200 is provided with an image-data-generation section 20 whichis composed of a circuit for performing processing whereby line buffers52 a through 52 d for a plurality of lines reserved in advance in theSD-RAM 52 are utilized, and image data for displaying an image of thesubject in the display section 40 are generated by pipeline processing.This ASIC 200 may be a digital signal processor (DSP) for imageprocessing as well. The line buffers 52 a through 52 d for a pluralityof lines may also be provided to the image-data-generation section 20 oranother component. The display section 40 displays the subject on theliquid crystal panel 42 on the basis of the generated image data. Inother words, the user can confirm the subject while utilizing thedisplay section 40 as an EVF.

In a case in which the user operates the operating section 55 to issuean image capture instruction, in response to the image captureinstruction, the area image sensor 15 starts outputting theimage-capture data for a single frame in accordance with the verticalsynchronization signal SVsync, and sequentially reads the image-capturedata which indicate the detection results of the photodiodescorresponding to all of the effective pixels of the area image sensor 15at a timing in accordance with the data clock signal SDotclock withinthe period prescribed by the horizontal synchronization signal SHsync.The image-data-generation section 20 then utilizes the SD-RAM 52 oranother component to generate image data in a JPEG format or otherformat, and the image data are recorded in a removable memory or thelike not shown in the drawing. In other words, the user can generateimage data for indicating the subject.

(2) Control of the Horizontal Synchronization Signal

In a case in which image data indicating a subject are recorded in theremovable memory or the like, and printing or another operation isconsidered, the number of pixels of the area image sensor 15 must begreater than a predetermined number in order to obtain high-qualityimage data. Therefore, the effective number of pixels of the area imagesensor 15 in the present embodiment is 5400 pixels in the horizontaldirection and 3600 pixels in the vertical direction, as shown in FIG. 2.The area image sensor 15 is provided with a large number of pixels inexcess of the effective pixels in the horizontal direction and thevertical direction, but in order to simplify the present specification,no description is given of the processing that relates to pixels otherthan the effective pixels.

On the other hand, the liquid crystal panel 42 is provided with 1024pixels in the horizontal direction and 768 pixels in the verticaldirection, as described above, and is configured so that the image ofthe subject is displayed in the subject image display region (R1 shownin FIG. 2). In the present embodiment, in order to display the image ofthe subject as large as possible while maintaining the aspect ratio(2:3) of the area image sensor 15, a rectangular region of a 2:3 aspectratio whose top side and left and right sides contact the top side andleft and right sides of the liquid crystal panel 42 is adopted as thesubject image display region R1 for displaying the image of the subject.The remaining region is the information display region (region shown inFIG. 2) for displaying characters indicating image-capturing conditionsor other information. Consequently, the subject image display region R1in the liquid crystal panel 42 is composed of 1024 pixels in thehorizontal direction and 682 pixels in the vertical direction. Asdescribed above, the number of pixels of the area image sensor 15 andthe number of pixels of the liquid crystal panel 42 are not the same inthe present embodiment.

Furthermore, since the display in the display section 40 is utilized bythe user to confirm the subject, when the delay between the timing atwhich the subject is captured by the area image sensor 15 and the timingat which the image of the captured subject is displayed by the displaysection 40 is noticeable by the user, the subject seen in the EVF andthe recorded image of the subject are misaligned, and the EVF becomesextremely difficult to use. The delay must therefore be minimal when thedisplay section 40 is used as an EVF.

Therefore, in order for the image captured by the area image sensor 15to be displayed in the display section 40 so that the delay is soextremely short as to not be seen by the human eye, a configuration isadopted in the present embodiment whereby various types of processingare performed by the area image sensor 15 and the image-data-generationsection 20, and the display section 40 causes the image data generatedas a result of the processing to be displayed at high speed.

In other words, the area image sensor 15 according to the presentembodiment is provided with a circuit capable of executing interlacedscanning for reading the detection results of the photodiodes at a ratioof 1 for every n (where n is an odd number) lines aligned in thevertical direction. An adder is also provided for adding m (where m is anatural number) detection results aligned in the horizontal directionamong the photodiodes for performing photoelectric conversion via colorfilters of the same color, and outputting 1/m of the sum (i.e.,outputting the arithmetic average of the m detection results). Thepresent embodiment is configured so that when the display section 40 iscaused to function as an EVF, interlaced scanning and processing by theadder are executed in the area image sensor 15, whereby pixels in thehorizontal direction and the vertical direction are decimated, and theimage-capture data of a smaller number of pixels than the number ofpixels provided to the area image sensor 15 are outputted, and thesubject can thereby be captured at high speed.

In other words, in a live view mode for causing the display section 40to function as an EVF, the area image sensor 15 reads for lines in thevertical direction at a ratio of 1 for every n lines in accordance withthe horizontal synchronization signal SHsync. Processing for outputtingthe result of adding the detection results of m photodiodes asimage-capture data by the adder is also performed in accordance with thedata clock signal SDotclock. FIG. 3 shows an example of the method foroutputting the image-capture data of a smaller number of pixels than thenumber of pixels provided to the area image sensor 15 in the presentembodiment. In FIG. 3, the rectangles labeled R indicate photodiodesthat correspond to color filters for transmitting light in a redspectrum, the rectangles labeled G indicate photodiodes that correspondto color filters for transmitting light in a green spectrum, and therectangles labeled B indicate photodiodes that correspond to colorfilters for transmitting light in a blue spectrum.

As shown in FIG. 3, in a case in which the color filters of the pixelsindicated by rectangles are in a Bayer array, since a color filter ofonly one color corresponds to each pixel, the color of each pixel mustbe interpolated by utilizing the surrounding pixels. Therefore, whenlines are decimated to acquire the image-capture data, decimation mustbe performed so that the color filters of adjacent lines afterdecimation are of a different color. Therefore, in the presentembodiment, by acquiring the detection values in the photodiodes of eachline at a ratio of 1 line for every n lines (where n is an odd number)as the image-capture data, it is possible to acquire image-capture datain which the color of each pixel can be specified by interpolation. Inthe present embodiment, a configuration is adopted in which theimage-capture data are acquired at a ratio of 1 line for every 5 linesin order to make the number of lines in the vertical direction of thearea image sensor 15 as close as possible to the number of lines in thevertical direction of the subject image display region R1 of the liquidcrystal panel 42. In FIG. 3, the left-directed arrows indicate thatimage-capture data are acquired at a ratio of 1 line for every 5 lines,and in this example, the number of lines in the vertical direction is ⅕,i.e., 720.

In a case in which the color filters are in a Bayer array, the colors ofadjacent pixels in the horizontal direction are different, and the samecolor of color filter occurs at every other position. Therefore,decimation processing can essentially be performed by adding m at everyother pixel for pixels aligned in the horizontal direction andmultiplying the sum by 1/m (i.e., calculating the arithmetic average ofm detection results). In the present embodiment, m is set to 3, due tosuch factors as limitations for the sake of image quality in cases inwhich adding is performed by the adder. In the configuration shown inFIG. 3, in the lowest line shown, the detection results of the threephotodiodes aligned in the horizontal direction that are photodiodes forperforming photoelectric conversion via green color filters are added byan adder S1 and multiplied by ⅓, and the detection results of the threephotodiodes aligned in the horizontal direction that are photodiodes forperforming photoelectric conversion via red color filters are added byan adder S2 and multiplied by ⅓. In this example, the number of pixelsin the horizontal direction is ⅓, i.e., 1800 pixels. In FIG. 2, the datasize after decimation in the area image sensor 15 is indicated by thedashed-line rectangle 15 a.

As described above, in the area image sensor 15, the number of lines inthe vertical direction may be set to 720, and the number of pixels inthe horizontal direction may be set to 1800. However, in suchdecimation, because of n being an odd number in the vertical direction,m being a natural number in the horizontal direction, and other suchlimitations for the sake of image quality, the number of pixels afterdecimation and the number of pixels of the subject image display regionR1 of the liquid crystal panel 42 do not readily coincide. In a case inwhich n and m differ, as described above, the aspect ratio differsbetween the subject and the subject image on the liquid crystal panel42.

A configuration is therefore adopted in the present embodiment in whichresizing is further performed in the image-data-generation section 20for the decimated image-capture data, and image data are generated fordisplay in the subject image display region R1 of the liquid crystalpanel 42. In other words, the image-data-generation section 20 isprovided with a pixel interpolation section 20 a, a color reproductionprocessing section 20 b, a filter processing section 20 c, a gammacorrection section 20 d, and a resizing processing section 20 e. In thisconfiguration, the number of pixels in the vertical direction and thehorizontal direction is modified by the resizing processing section 20 ein the process of generating the image data, and image data aregenerated which are equivalent to the number of pixels of the subjectimage display region R1 of the liquid crystal panel 42.

The line buffer 52 a is a buffer memory for temporarily recording thedecimated image-capture data outputted from the area image sensor 15,and when the decimated image-capture data are outputted from the areaimage sensor 15, the image-capture data are temporarily recorded in theline buffer 52 a by the processing of the image-data-generation section20. The pixel interpolation section 20 a imports data of the necessarynumber of pixels for generating the colors of the two channels missingin each pixel in the Bayer array from the line buffer 52 a, and whiledoing so, generates the colors of the two channels by interpolationprocessing. As a result, three channels of data are generated in eachpixel. The color reproduction processing section 20 b then performscolor conversion processing for color matching by performing a 3×3matrix computation on the basis of the generated data. The datagenerated by color conversion processing are temporarily recorded in theline buffer 52 b. The filter processing section 20 c then executessharpness adjustment, noise removal processing, and other processing byfilter processing. The gamma correction section 20 d then executes gammacorrection to compensate for a characteristic difference between thecolors indicated by the gradation values of the image-capture data ofthe area image sensor 15 and the colors indicated by the gradationvalues of the image data handled by the display section 40. The datagenerated by gamma correction are temporarily recorded in the linebuffer 52 c.

The number of pixels in the data that is recorded line by line in theline buffer 52 c in question is one obtained through decimation in thearea image sensor 15. In other words, data of 720 lines in the verticaldirection and 1800 pixels in the horizontal direction are recorded lineby line. The resizing processing section 20 e performs resizing bysequentially referencing the data recorded in the line buffer 52 c toperform interpolation computation processing and specify the gradationvalue of each channel in the positions between pixels. In the presentembodiment, since the decimation in the area image sensor 15 describedabove is ⅕ in the vertical direction and ⅓ in the horizontal direction,the aspect ratio of the decimated data differs from the aspect ratio ofthe image-capture data of the area image sensor 15, as shown in therectangle 15 a in FIG. 2. Therefore, the resizing processing section 20e first performs reduction processing for reduction to a size ofapproximately 57% in the horizontal direction on the basis of the datarecorded in the line buffer 52 c. As a result, the number of pixels inthe horizontal direction is set to 1024. The resizing processing section20 e also performs reduction processing for reduction to a size ofapproximately 95% in the vertical direction. As a result, image data aregenerated for which there are 1024 pixels in the horizontal directionand 682 lines in the vertical direction. The generated image data arerecorded line by line in the line buffer 52 d.

In the present embodiment, by the processing described above, generationprocessing is performed for generating image data that can be displayedin the subject image display region R1 of the liquid crystal panel 42 onthe basis of the image-capture data of the area image sensor 15, but theimage-capture data of the area image sensor 15 have 720 lines in thevertical direction, whereas the number of lines of the image data in thevertical direction is 682, and the number of lines of the liquid crystalpanel 42 in the vertical direction is 768. In other words, differentnumbers of lines are required to capture a single frame and to display asingle frame.

Therefore, in the present embodiment, the horizontal synchronizationsignal SHsync, the vertical synchronization signal SVsync, the dataactive signal SDactive, and the data clock signal SDotclock of the areaimage sensor 15 are set to the cycle necessary for driving the areaimage sensor 15. In other words, the timing generator 30 outputs thehorizontal synchronization signal SHsync the number of times and at thetiming whereby the decimation in the vertical direction such asdescribed above can be performed in the area image sensor 15, and theimage-capture data of the number of lines of a single frame can beacquired within the period prescribed by the vertical synchronizationsignal SVsync. The timing generator 30 also outputs the data clocksignal SDotclock the number of times and at the timing wherebydecimation in the horizontal direction such as described above can beperformed, and the image-capture data of the number of pixels of asingle line can be acquired within the period prescribed by thehorizontal synchronization signal SHsync.

On the other hand, in order to minimize the delay period and performdisplay in the liquid crystal panel 42 on the basis of theimage-capturing data outputted line by line from the area image sensor15, a configuration is adopted in the present embodiment whereby thehorizontal synchronization signal DHsync is outputted at the time thatthe image data for display of each line of the liquid crystal panel 42are prepared. In other words, the liquid crystal panel 42 in the presentembodiment is capable of displaying lines for which processing by theresizing processing section 20 e is ended. The timing generator 30therefore outputs the horizontal synchronization signal DHsync fordisplaying the Nth line in the vertical direction of the liquid crystalpanel 42 at the time that the processing for generating the image dataof the Nth line (where N is a natural number) is ended.

Specifically, the timing generator 30 is provided with a progressinformation acquisition section 30 a, and the progress informationacquisition section 30 a is capable of acquiring, from the resizingprocessing section 20 e, progress information for indicating a line forwhich the processing for generating image data is ended in the resizingprocessing section 20 e. Consequently, through this progressinformation, it is possible to specify a line that can be displayed inthe liquid crystal panel 42 on the basis of the image data. Therefore,in this configuration, the timing generator 30 outputs the horizontalsynchronization signal DHsync in synchrony with the timing at which theprocessing for generating the image data of each line is ended, anddisplay of a line for which the processing for generating the image datais thereby started in the liquid crystal panel 42. Through thisconfiguration, display of each line does not start before preparation ofthe image data is finished, and each line can be immediately displayedwith the display preparation thereof is finished.

Since the liquid crystal panel 42 is preferably capable of displayingthe pixels of each line of the liquid crystal panel 42 within thehorizontal synchronization period prescribed by the output timing of thehorizontal synchronization signal DHsync, the timing generator 30outputs the data active signal DDactive and the data clock signalDDotclock so that the pixels of a single line can be displayed within aperiod assumed to be the period in which the horizontal synchronizationperiod prescribed by the output timing of the horizontal synchronizationsignal DHsync is shortest.

In the present embodiment, the vertical synchronization signal SVsync ofthe area image sensor 15 and the vertical synchronization signal DVsyncof the liquid crystal panel 42 are set so as to be synchronized in orderto prevent the image-capture data from the area image sensor 15 and thedisplay by the liquid crystal panel 42 from becoming inconsistent byframe units. In other words, the timing generator 30 outputs thevertical synchronization signal DVsync of the display section 40 after apredetermined period from the timing at which the verticalsynchronization signal SVsync of the area image sensor 15 is outputted.As a result, the cycles of the vertical synchronization signals SVsync,DVsync are the same and constant in the present embodiment.Consequently, the display in the liquid crystal panel 42 of the subjectcaptured by the area image sensor 15 is not delayed by the period of asingle frame or longer, and a display of an image of the subjectcaptured at the same timing does not remain on the liquid crystal panel42 for a period of a plurality of frames.

Since the horizontal synchronization period prescribed by the horizontalsynchronization signal DHsync of the liquid crystal panel 42 is ofvariable length in the present embodiment, the cycles of the verticalsynchronization signals SVsync, DVsync are the same and constant evenwhen the horizontal synchronization period varies. Specifically, thetiming generator 30 controls the output signal so that the verticalsynchronization period for displaying a single frame is constant bylengthening or shortening the horizontal synchronization period withrespect to a reference period TH determined in advance, and therebycanceling out the time fluctuation from a reference period TH. Thereference period TH is configured as the horizontal synchronizationperiod in a case in which each of the total number of lines of theliquid crystal panel 42 is displayed for an equal period within thevertical synchronization period.

In the subject image display region R1, a state is attained in which thehorizontal synchronization period can be lengthened by waiting to outputthe horizontal synchronization signal DHsync until the processing forgenerating the image data of each line is ended. In the informationdisplay region R2 of the liquid crystal panel 42 for displayingcharacters indicating image-capturing conditions or other information,the horizontal synchronization period is made shorter than the referenceperiod TH so as to cancel out the cumulative total of the difference ofthe horizontal synchronization period lengthened in the subject imagedisplay region R1 and the reference period TH.

FIG. 4 shows the horizontal synchronization signal DHsync outputted fromthe timing generator 30 configured as described above, and also showsthe data active signal DDactive, the data clock signal DDotclock, andthe progress information. The progress information outputted from theresizing processing section 20 e in the present embodiment is composedof a single pulse in which a low-level output is maintained as theprocessing for generating the image data for a single line is beingexecuted, and a high-level output occurs at a predetermined period atthe time that the processing for generating the image data for a singleline is ended.

When the timing generator 30 acquires the progress information throughthe progress information acquisition section 30 a, the horizontalsynchronization signal DHsync is outputted in synchrony with the pulseof the progress information by the processing of the display controlsection 30 b. Therefore, even in a case in which the processing forgenerating the image data of a certain line fails to occur within thereference period TH, the horizontal synchronization signal DHsync is notoutputted until the generation processing is ended, and a horizontalsynchronization period TDH becomes longer than the reference period TH.Consequently, in a case in which the processing for generating the imagedata of a certain line fails to occur within the reference period TH,display of the certain line is not started in the liquid crystal panel42 until the generation processing is completed. Display is also notperformed before preparation of the image data of each line is ended.Furthermore, since the horizontal synchronization signal DHsync isoutputted when the processing for generating the image data of a certainline is ended, the image data of each line is displayed without delaywhen preparation thereof is ended. As described above, since the liquidcrystal panel 42 in the present embodiment is driven in a state in whichthe horizontal synchronization period TDH may be longer than thereference period TH, aspects of the invention are suitable forapplication to a situation in which the period for generating the imagedata of a single line to be displayed by the liquid crystal panel 42 mayfluctuate. A possible example of such a situation is one in which thespeed of data output processing of the area image sensor 15 or theprocessing for generating image data by the image-data-generationsection 20 may differ for each line.

Aspects of the invention can also, of course, be applied in a situationin which the processing speed differs for each line depending on theimage-capturing conditions or the hardware used for capturing and image.For example, aspects of the invention can be applied to a configurationin which the vertical synchronization period or the horizontalsynchronization period of the area image sensor 15 fluctuates, or theperiod needed for processing for generating image data fluctuates due toan operation of the operating section 55 by the user. Aspects of theinvention can also be applied to a configuration in which the verticalsynchronization period or the horizontal synchronization period of thearea image sensor 15 fluctuates, or the period needed for processing forgenerating image data fluctuates due to the changing of aninterchangeable EVF or an interchangeable lens.

As described above, in the subject image display region R1 in thepresent embodiment, the timing generator 30 adjusts the horizontalsynchronization period TDH in accordance with the progress informationoutputted from the resizing processing section 20 e. The horizontalsynchronization signal DHsync may therefore be lengthened according tothe progress of the processing for generating the image data to bedisplayed in the subject image display region R1, and the horizontalsynchronization period TDH prescribed by the horizontal synchronizationsignal DHsync of the liquid crystal panel 42 is not necessarilyconstant. On the other hand, since the vertical synchronization periodprescribed by the vertical synchronization signal DVsync is constant inthe present embodiment, as described above, the timing generator 30 setsthe output timing of the horizontal synchronization signal DHsync sothat a horizontal synchronization period TDH2 is shorter than theabovementioned reference period TH in the information display region R2,so that displaying of all the lines of the liquid crystal panel 42 endswithin the vertical synchronization period even in a case in which thehorizontal synchronization period TDH in the subject image displayregion R1 is lengthened.

In other words, since the data (referred to as OSD data) of thecharacters indicating the image-capturing conditions or otherinformation can be created in advance and recorded in advance in theVRAM 51 irrespective of operation of the area image sensor 15, anappropriate display can be performed without overtaking the reading ofdata even when a display based on the OSD data is executed according toa short horizontal synchronization period. Therefore, in the presentembodiment, the horizontal synchronization period in the informationdisplay region R2 for displaying characters indicating image-capturingconditions or other information is set so as to be shorter than that ofthe subject image display region R1 for producing a display based on theimage-capture data of the area image sensor 15.

Specifically, the timing generator 30 adjusts the output timing of thehorizontal synchronization signal DHsync, and thereby shortens thehorizontal synchronization period TDH2 so that the sum of thedifferences of the lengthened horizontal synchronization period TDH andthe reference period TH in the subject image display region R1, and thesum of the differences of the shortened horizontal synchronizationperiod TDH2 and the reference period TH in the information displayregion R2 coincide. As a result, the following relation obtains:horizontal synchronization period TDH2<reference period≤horizontalsynchronization period TDH. Various configurations can be adopted in theinformation display region R2 as configurations whereby the horizontalsynchronization signal DHsync is outputted so that the horizontalsynchronization period TDH2 is shorter than the reference period TH. Forexample, as shown in FIG. 4, a configuration may be adopted in which theperiod of shortening in each line is equal to a value T2 obtained bydividing the sum of delay T1 (ΣT1) with respect to the horizontalsynchronization period TH generated in the subject image display regionR1 by the number of lines L2 of the information display region R2. Inother words, a configuration may be adopted in which the value ofhorizontal synchronization period TH−ΔT2 is assumed to be the horizontalsynchronization period TDH2 in the information display region R2.

As described above, in order to produce a suitable display in eachregion on the basis of the horizontal synchronization signal adjustedfor each region of the liquid crystal panel 42 in the presentembodiment, the line numbers of the portions of the liquid crystal panel42 that correspond to the subject image display region R1 and theinformation display region R2 are determined in advance. For example, inthe example shown in FIG. 2, lines 1 through 682 are the subject imagedisplay region R1, and lines 683 through 768 are the information displayregion R2. Therefore, the timing generator 30 outputs the horizontalsynchronization signal DHsync so that the horizontal synchronizationperiod TDH2 is shorter than the abovementioned reference period THduring display in the information display region R2 that corresponds tolines 683 through 768, while the timing generator 30 outputs thehorizontal synchronization signal DHsync at a timing in accordance withthe abovementioned progress information during display in the subjectimage display region R1 that corresponds to lines 1 through 682.

The ASIC 200 is also provided with an image data output section 201, andthe image data output section 201 outputs the image data (Data) recordedin the line buffer 52 d to the display section 40 line by line duringdisplay of lines 1 through 682 of the liquid crystal panel 42. As aresult, the image of the subject captured by the area image sensor 15 isdisplayed in the subject image display region R1.

The CPU 50 records OSD data to the VRAM 51 prior to at least display inan information display region R2. During display in lines 683 through768 of the liquid crystal panel 42, the image data output section 201outputs the OSD data recorded in the VRAM 51 to the display section 40line by line as the image data (Data). As a result, charactersindicating image-capturing conditions and the like are displayed in theinformation display region R2.

Through this configuration, display of image-capturing conditions orother information by the OSD data is performed within a short horizontalsynchronization period in the information display region R2, while thesubject captured by the area image sensor 15 is displayed in the subjectimage display region R1 in a state of minimal delay. Then, in the mannerdescribed above, the horizontal synchronization periods are controlledsuch that the sum of differences between the reference period TH and thelengthened horizontal synchronization period TDH in the subject imagedisplay region R1 and the sum of differences between the referenceperiod TH and the shortened horizontal synchronization period TDH2 inthe information display region R2 coincide, whereby display by thedisplay section 40 can take place under conditions in which the cyclesof the vertical synchronization signals SVsync, DVsync are the same andconstant. Consequently, the display in the liquid crystal panel 42 ofthe subject captured by the area image sensor 15 is not delayed by theperiod of a single frame or longer, and the same image does not remaindisplayed on the liquid crystal panel 42 for a plurality of frameperiods.

(3) Control of Signals Applied to the Area Image Sensor

In the present embodiment, furthermore, the output timing of thevertical synchronization signals SVsync varies in accordance withconditions of progress of processing by the image data processingsection 20. For this purpose, the timing generator 30 is provided with asensor control section 30 c (corresponding to the image capture controlsection). The sensor control section 30 c outputs a verticalsynchronization signal SVsync at points in time that preparations are inorder for carrying out processing to generate image data of the frame(next frame) that follows a frame (current frame) currently beingprocessed to generate current image data. As mentioned above, in thecase that the time needed for processing to generate image data differsfor individual lines, the time needed for processing to generate imagedata corresponding to the equivalent of one frame may differ as well.FIG. 5A shows an example thereof. Let the reference cycle of thevertical synchronization signal SVsync be denoted as TSV0. The exampleof FIG. 5A depicts a situation in which, at a timing coincident withoutput of a vertical synchronization signal corresponding to the n+1-thframe (the timing of the reference cycle TSV0), image data generationprocessing for the n-th frame has ended, and preparations are in orderfor starting processing to generate image data of the n+1-th frame. Theprogress information shown in FIG. 5A is a signal identical to theprogress information described using FIG. 4.

The n+1-th frame of FIG. 5A shows an example in which, at a timingcoincident with the elapsing of the reference cycle TSV0 followingoutput of a vertical synchronization signal SVsync corresponding to then+1-th frame, preparations are not yet in order for starting processingto generate image data of the n+2-th frame. In other words, at a timingcoincident with the elapsing of the reference cycle TSV0, processing togenerate image data corresponding to the n+1-th frame up through thelast line thereof has not yet ended. The description continues on theassumption that, in the present embodiment, there has arisen a statewhereby after generation of image data corresponding to the last line ofthe current frame has ended and the image data has been output to thedisplay section 40 by the image data output section 201, in theimage-data-generation section 20 preparations are not yet in order foracquiring the image-capture data corresponding to the next frame andstarting processing to generate the image data of the next frame. At atiming coincident with the elapsing of the reference cycle TSV0following output of a vertical synchronization signal SVsynccorresponding to the n+1-th frame of FIG. 5A, if processing to generateimage data corresponding to the last line of the n+1-th frame has notyet ended, when a vertical synchronization signal SVsync is output atthe timing in question the image-capture data corresponding to the nextframe will be imported from the area image sensor 15 in a state in whichpreparations for starting processing to generate image datacorresponding to the next frame are not yet in order in theimage-data-generation section 20.

In order to prevent this, at a timing coincident with the elapsing ofthe reference cycle TSV0, the sensor control section 30 c determineswhether or not a period that extends from the start of processing togenerate image data corresponding to one frame, up to a state in whichpreparations are in order for starting processing to generate image datacorresponding to the next frame, should be made longer than thereference cycle TSV0; and, if the period is to be lengthened, waits tooutput a vertical synchronization signal SVsync for the next frame untilpreparations for carrying out processing to generate image datacorresponding to the next frame are in order in theimage-data-generation section 20. Then, after preparations are in orderin the image-data-generation section 20, the sensor control section 30 coutputs a vertical synchronization signal SVsync to the area imagesensor 15.

The reference cycle TSD0 of the dot clocks SDotclock which are output tothe area image sensor 15 is determined in advance by the specificationsof the area image sensor 15. Likewise, the reference pulse count PSD0 ofa dot clock SDotclock output to the area image sensor 15 during theperiod of one cycle of a horizontal synchronization signal SHsync isalso determined in advance as a specification of the area image sensor15. Further, the reference pulse count PSH0 of a horizontalsynchronization signal SHsync output to the area image sensor 15 duringthe period of one cycle of a vertical synchronization signal SVsync isdetermined as well. Similarly, the reference cycle TSV0 of the verticalsynchronization signals SVsync is determined in advance byspecifications.

In the present embodiment, for the purpose of determining whether or notto lengthen the period for putting preparations in order for processingto generate image data corresponding to the next frame to a periodlonger than the reference cycle TSV0, the number of lines for whichprocessing to generate image data has been completed is identified fromprogress information of line units output from the resizing processingsection 20 e. Within the period of the reference cycle TSV0, ifprocessing for generating image data up through the last line has ended,a vertical synchronization signal SVsync for the purpose of importingthe image-capture data of the next frame is output at timing coincidentwith the reference cycle TSV0 (the n+1-th vertical synchronizationsignal of FIG. 5A). At a timing coincident with the elapsing of theperiod of the reference cycle TSV0, if processing for generating imagedata up through the last line has not yet ended, the sensor controlsection 30 c outputs a vertical synchronization signal SVsync (then+2-th vertical synchronization signal of FIG. 5A) only after havingverified, on the basis of progress information, the fact that processingto generate image data corresponding to the last line has ended. Inother words, the sensor control section 30 c prolongs the actual cycleTSV of the vertical synchronization signal SVsync for a period longerthan the reference cycle TSV0.

Specifically, in the case that, at a timing coincident with the elapsingof the reference cycle TSV0, processing to generate the image data upthrough the last line has not ended, the sensor control section 30 ccontinues to output dummy horizontal synchronization signals SHsync asshown in FIG. 5A, until it is verified on the basis of the progressinformation that processing to generate the image data corresponding tothe last line has ended. In other words, horizontal synchronizationsignals SHsync are output in excess of the reference pulse count PSH0which is output in the reference cycle TSV0, and the period until outputof the next vertical synchronization signal SVsync (cycle TSV) is madelonger than the reference cycle TSV0. The circuit configuration in thepresent embodiment is such that, despite dummy horizontalsynchronization signals SHsync being output in excess of the referencepulse count PSH0, no vertical synchronization signal SVsync is outputfor an interval which lasts until output of a pulse of progressinformation indicating that the processing to generate image data of thelast line has ended. The area image sensor 15 ignores the dummyhorizontal synchronization signals SHsync, and dummy image-capture datais not generated in response to the signals in question. In the case ofthe example shown in FIG. 5A, the cycle TSD of the dot clocks SDotclockremains at the reference cycle TSD0, and the cycle TSH of the horizontalsynchronization signals SHsync remains at the reference cycle TSH0.

As another method for prolonging a vertical synchronization signalSVsync, as shown in FIG. 5B, the sensor control section 30 c mayincrease the pulse count PSD of the dot clock SDotclocks during theperiod of one cycle of a horizontal synchronization signal SHsync to apulse count greater than the reference pulse count PSD0, therebyprolonging the cycle TSH of the horizontal synchronization signal SHsyncfor a duration longer than the reference cycle TSH0. As a result, theperiod until output of the next vertical synchronization signal SVsync(cycle TSV) may be made longer than the reference cycle TSV0. The areaimage sensor 15 ignores the dummy dot clocks SDotclock, and dummyimage-capture data is not generated in response to the signals inquestion. Also, in a case where the cycle TSH of a horizontalsynchronization signal SHsync is made longer than the reference cycleTSH0 by increasing the pulse count PSD of the dot clocks SDotclockduring the period of one cycle of a horizontal synchronization signalSHsync to a pulse count greater than the reference pulse count PSD0, thenumber of pulses of the horizontal synchronization signals SHsyncgenerated in the period of one cycle of a vertical synchronizationsignal SVsync is preferably constant, but the number of pulses of thehorizontal synchronization signals SHsync generated in the period of onecycle of a vertical synchronization signal SVsync may be variable aswell. At this time, the cycle TSD of the dot clock SDotclocks remains atthe reference cycle TSD0.

Alternatively, as shown in FIG. 5C, without reducing the pulse count PSDof the dot clocks SDotclock during the period of one cycle of ahorizontal synchronization signal SHsync, the sensor control section 30c may make the cycle TSH of a horizontal synchronization signal SHsynclonger than the reference cycle TSH0 by making the cycle TSD of a dotclock SDotclock longer than the reference cycle TSD0. As a result, theperiod until output of the next vertical synchronization signal SVsync(cycle TSV) may be may be made longer than the reference cycle TSV0. Inthis case, the pulse count PSH of the horizontal synchronization signalsSHsync per cycle of a vertical synchronization signal SVsync is notbrought lower than the reference pulse count PSH0.

As described above, in the present embodiment, acquisition ofimage-capture data from the area image sensor 15 can start in a state inwhich preparations are in order for starting processing to generate theimage data of the next frame. As a result, image-capture data can beprevented from overwriting or destroying lines for which processing togenerate image data is not yet complete.

(4) Other Embodiments

The embodiment described above is merely one example of implementing theinvention, it being possible to adopt various other embodiments, such ascombinations of the following modified examples, without departing fromthe spirit of the invention.

For example, a back porch of the horizontal synchronization signalDHsync may be lengthened when the horizontal synchronization period TDHis made longer than the reference period TH. In this configuration, theoutput period of progress information from the resizing processingsection 20 e is detected in the progress information acquisition section30 a in the configuration shown in FIG. 1. In other words, the periodTS(N−1) is detected between the progress information outputted at thetime that processing for generating the image data of the (N−1)th lineis ended and the progress information outputted at the time thatprocessing for generating the image data of the Nth line is ended. Thetiming generator 30 then determines the length of the back porch of thehorizontal synchronization signal DHsync of the Nth line on the basis ofthe period TS(N−1), and outputs various types of signals.

In other words, by the processing of the display control section 30 b,the timing generator 30 outputs a signal DHsync2 indicating a prechargeperiod when a period ΔT1 has elapsed after outputting of the horizontalsynchronization signal DHsync of the Nth line, as shown in FIG. 6, theperiod ΔT1 being obtained by subtracting the length of the referenceperiod TH from the length of the period TS(N−1). By the processing ofthe display control section 300 b, the timing generator 30 then outputsDDactive when the predetermined precharge period has elapsed afteroutputting of the signal DHsync2, and outputs the horizontalsynchronization signal DHsync of the (N+1)th line, providing a frontporch having a predetermined period after maintaining the level ofDDactive until the data clock signal DDotclock of the number of pixelsof a single line is outputted. The period from the start of theprecharge period until the end of the front porch coincides with thereference period TH. Consequently, the horizontal synchronization periodTDH, which is the period between the horizontal synchronization signalDHsync of the Nth line and the horizontal synchronization signal DHsyncof the (N+1)th line, is the sum of the reference period TH and ΔT1. As aresult, N lines can be displayed with precharging, inversion, and otheroperations synchronized with the signal DHsync2 in the liquid crystalpanel 42, and the horizontal synchronization period TDH can be madelonger than the reference period TH.

In the first embodiment described above, since the front porch of thehorizontal synchronization signal DHsync is lengthened, the back porchperiod can be set as a constant period, and the period for performingprecharging, inversion, and other operations can be provided accordingto normal specifications.

In the embodiment described above, the horizontal synchronization signalSHsync is outputted so that the horizontal synchronization period isshorter in the information display region R2 of the liquid crystal panel42 than in the subject image display region R1, in order to cause thecycle of the vertical synchronization signal SVsync of the area imagesensor 15 and the cycle of the vertical synchronization signal DVsync ofthe liquid crystal panel 42 to coincide, but the cycle of the verticalsynchronization signal SVsync and the cycle of the verticalsynchronization signal DVsync of the liquid crystal panel 42 can be madeto coincide by another method. For example, since the area image sensor15 has a larger number of lines than the liquid crystal panel 42 in anormal image-capturing device, in a case in which the horizontalsynchronization period that should be maintained within a specificvertical synchronization period is assumed to be equal, the cycle of thehorizontal synchronization signal DHsync of the liquid crystal panel 42is shorter than the cycle of the horizontal synchronization signalSHsync of the area image sensor 15. Consequently, even in a case inwhich the horizontal synchronization signal DHsync of the liquid crystalpanel 42 is lengthened, it is not often necessary to lengthen thevertical synchronization period of the liquid crystal panel 42 accordingto the lengthening of the horizontal synchronization signal DHsync. In acase in which lengthening the horizontal synchronization signal DHsynccauses the vertical synchronization signal DVsync of the liquid crystalpanel 42 to be longer than the vertical synchronization signal SVsync ofthe area image sensor 15, the vertical synchronization signal SVsync ofthe area image sensor 15 may be lengthened, and the verticalsynchronization signal DVsync and vertical synchronization signal SVsyncmay be synchronized.

In the embodiment described above, a configuration is adopted in whichprogress information is acquired which indicates for each line whetherthe resizing processing of the processing for generating image data isended, but any configuration may be adopted insofar as progressinformation for the processing of the final step is acquired, even in acase in which the final step of the processing for generating the imagedata is not the resizing processing. A configuration may also be adoptedin which the progress information is acquired for processing of a stepprior to the final step (e.g., a step in which the processing time mayfluctuate), insofar as processing can be performed at such a high speedthat the processing time of the final step of processing for generatingthe image data can be ignored, processing can be performed in a certaintime, or it is possible to predict the ending of the final step. In acase in which an image processing step is included for referencing thedata of a plurality of lines and generating data of a single line in theprocessing for generating the image data, the progress information maybe acquired for the included step. Specifically, it is not necessarythat processing for generating image data already be complete at thepoint in time that the progress information is acquired; instead, thetiming of completion of processing for generating image data may bepredicted on the basis of acquired progress information.

FIG. 7 is a view showing an image-capturing device 1 that is configuredso as to acquire progress information for a plurality of imageprocessing steps for referencing the data of a plurality of lines togenerate data of a single line. In FIG. 7, the same reference symbols asthose of FIG. 1 are used to refer to constituent elements that are thesame as those in FIG. 1. A timing generator 300 of the image-capturingdevice 1 shown in FIG. 7 is capable of acquiring progress informationwhich indicates a line for which outputting of the image-capture datafrom the area image sensor 15 is completed, and a line for which theprocessing for generating data in each of the color reproductionprocessing section 20 b, the gamma correction section 20 d, and theresizing processing section 20 e of the image-data-generation section 20is ended. By the processing of a display control section 300 b, thetiming generator 300 is capable of outputting a trigger signal (e.g., ahorizontal synchronization signal) for starting processing forgenerating data of a single line to each of the pixel interpolationsection 20 a, the filter processing section 20 c, and the resizingprocessing section 20 e.

In other words, in the embodiment shown in FIG. 7, processing of data ofan Lth line can be executed in the pixel interpolation section 20 a whenthe image-capture data of a Kth line is outputted from the area imagesensor 15, and as a result of line-by-line processing by the pixelinterpolation section 20 a and the color reproduction processing section20 b, specification is made in advance that the processing of data of anMth line in the filter processing section 20 c can be executed whenprocessing of the data of the Lth line is ended. As a result ofline-by-line processing by the filter processing section 20 c and thegamma correction section 20 d, specification is also made in advancethat the processing for generating image data of an Nth line can bestarted in the resizing processing section 20 e when processing of thedata of the Mth line is ended.

The timing generator 300 specifies that image-capture data of the Kthline is outputted from the area image sensor 15 on the basis of ahorizontal synchronization signal SHsync having a prescribed cycleoutputted by the timing generator 300. In a case in which specificationis made that the image-capture data of the Kth line is outputted fromthe area image sensor 15, the timing generator 300 outputs the triggersignal to the pixel interpolation section 20 a to start data processingof the Lth line. In a case in which a progress information acquisitionsection 300 a specifies that processing of the data of the Lth line isended in the color reproduction processing section 20 b, the timinggenerator 300 outputs the trigger signal to the filter processingsection 20 c to start data processing of the Mth line. In a case inwhich the progress information acquisition section 300 a specifies thatprocessing of the data of the Mth line is ended in the gamma correctionsection 20 d, the timing generator 300 outputs the trigger signal to theresizing processing section 20 e to start processing for generating theimage data of the Nth line.

When specification is made that processing for generating the image dataof the Nth line by the resizing processing section 20 e is ended, thetiming generator 300 outputs the horizontal synchronization signalDHsync for displaying the Nth line, in the same manner as in theembodiment described above. In other words, in the image-data-generationsection 20, in an image processing step in which it is possible to startgenerating data of a line which is subsequent to recording of the dataof two or more lines in a line buffer, a determination is made as towhether processing for generating data of the lowest necessary number oflines is ended, and the next image processing step is started at thetime that the generation processing is ended. Through thisconfiguration, processing for each line does not start beforepreparation of the necessary data for executing each step is finished,and processing for each line can be immediately started when the data ofeach line are prepared. As a result, the wait time during execution ofeach image processing step is minimized. In the present embodiment,since the data of only the lowest necessary number of lines istemporarily recorded in the line buffers 52 a through 52 d, the capacityof the line buffers 52 a through 52 d can be minimized.

Furthermore, the display section 40 is an EVF which uses a liquidcrystal panel in the embodiment described above, but the display section40 may be a display section other than an EVF. For example, the displaysection 40 may be a display section which uses a liquid crystal panelattached to a back surface of the image-capturing device 1, or a displaysection other than a liquid crystal panel may be used. Theimage-capturing device 1 may also be a single-lens reflex cameraprovided with a mirror, the image-capturing device 1 may be a moviecamera, or the image-capturing device 1 may be a mobile telephone orother device provided with image-capturing functionality. The colorfilters are also in a Bayer array in the area image sensor 15 describedabove, but aspects of the invention can also be applied in animage-capturing device which utilizes a sensor configured in anarrangement other than a Bayer array. The line buffer 52 d may be a linebuffer, but may also be a VRAM provided with a recording capacity forrecording the image data of a single frame. Through this configuration,various types of processing can be performed on the basis of the imagedata to be displayed. The horizontal synchronization period is alsopreferably lengthened with respect to a reference period, and varioustypes of periods can be assumed as the reference period. For example,the cycle of the horizontal synchronization signal SHsync of the areaimage sensor 15, the cycle for generating the image data, and othercycles may be used as the reference period. Furthermore, various formsmay be adopted as the form in which various types of signals aretransmitted from the timing generator 30 to the display section 40, andsignals may be transmitted by HDMI (high-definition multimediainterface) and other methods. The directions in the embodiment describedabove may also be reversed. In the horizontal direction, for example,display may be performed from left to right or from right to left.

Also, in relation to the configuration for varying the timing foroutputting vertical synchronization signals SVsync on the basis ofprogress information, in the embodiment above, there was described aconfiguration whereby preparations for starting processing to generateimage data of the next frame are put in order after processing togenerate image data up through the last line of the current frame isended. As another embodiment, there may be adopted a configurationwhereby preparations for processing to generate image data of the nextframe are put in order if processing is ended for generating image dataup through an L-th line (where L is less than the last line) of thecurrent frame within the period of the reference cycle TSV0. The L-thline may be predetermined in accordance with the buffer that stores theimage-capture data from the area image sensor, the buffers that storedata derived from the image-capture data in question by various types ofimage processing, and the like.

In the embodiment described above, there was described an example inwhich horizontal synchronization signals SHsync are output in excess ofthe reference pulse count PSH0 which is output in the reference cycleTSV0, and the period until output of the next vertical synchronizationsignal SVsync (cycle TSV) is made longer than the reference cycle TSV0.In a case where, for example, the reference pulse count PSH0 is set toinclude a margin (i.e., to the number of pulses required for theequivalent of a line, plus a margin), and it is desired to acceleratethe timing for generating the vertical synchronization signal SVsync, avertical synchronization signal SVsync may be generated at the point intime of generation of horizontal synchronization signals SHsync having asmaller number of pulses than the reference pulse count PSH0. Also, in acase where, for example, the reference pulse count PSD0 of the dotclocks SDotclock has been similarly set to include a margin, and it isdesired to accelerate the timing for generating the verticalsynchronization signals SVsync, a horizontal synchronization signalSHsync may be generated at the point in time of generation of dot clocksSDotclock having a smaller number of pulses than the reference pulsecount PSD0. As a result, the period until output of a verticalsynchronization signal SVsync (cycle TSV) may made shorter than thereference cycle TSV0.

Each of the processes that were carried out on individual single linesin the preceding embodiment may instead be carried out on individualpredetermined units such as a plurality of lines or a plurality ofpixels.

In the embodiment there is adopted a configuration in which the numberof pulses of subsignals which are generated a plurality of times withinthe period of one cycle of vertical synchronization signals, as well asthe generation cycle of the vertical synchronization signals, arevaried; and the timing for importing of image-capture data from theimage-capturing section is controlled in accordance with currentconditions. For example, it is possible for the cycle of generating avertical synchronization signal corresponding to the next frame to beextended until processing for generating image data that corresponds toone frame has ended, and as a result, to prevent overwriting ordestruction of unprocessed image-capture data.

Optionally, the image capture control section can vary the number ofpulses of a subsignals generated a plurality of times within the periodof one cycle of a vertical synchronization signal, whereby the cycle ofoutput of the vertical synchronization signals is varied. As one modefor doing so, for example, the number of pulses of horizontalsynchronization signals (subsignals) output within the period of onecycle of a vertical synchronization signal may be increased or decreasedto vary the cycle of the vertical synchronization signals.

In this case, the image-capturing section carries out generation ofimage-capture data on the basis of the horizontal synchronizationsignals; however, horizontal synchronization signal pulses in excess ofa predetermined number within the period of one cycle of the verticalsynchronization signals are ignored. The predetermined number signifies,for example, the number of lines contained in a single frame. Ignoringrefers, in other words, to not carrying out generating of image data inresponse to the signals in question.

Optionally, for example, the cycle of the horizontal synchronizationsignals may be varied by increasing or decreasing the number of pulsesof the dot clocks (subsignals) output within the period of one cycle ofthe horizontal synchronization signals, and varying the cycle of thevertical synchronization signals as a result. In this case, theimage-capturing section carries out generating of image-capture data onthe basis of the horizontal synchronization signals and the dot clocks,but dot clock pulses in excess of a predetermined number within theperiod of one cycle of the horizontal synchronization signals areignored. The predetermined number signifies, for example, the number ofdots contained in a single line. In this configuration, theimage-capturing control portion may generate a constant number ofhorizontal synchronization signals within the period of one cycle of thevertical synchronization signals without relying on an increase ordecrease in the number of pulses of the dot clocks; or may insteadincrease or decrease the number of pulses of the horizontalsynchronization signals within the period of one cycle of the verticalsynchronization signals.

The image-data-generation section is also preferably capable ofgenerating image data indicating an image of a subject on the basis ofimage-capture data of an image-capturing section (e.g., an area imagesensor), and displaying the image of the subject in the display sectionon the basis of the image data. The processing for generating image datamay comprise any type of image processing, and the period required forprocessing may fluctuate according to the image-capture data of theimage-capturing section, a mode in the image-capturing device, theimage-capturing conditions, or other factors. The period required forprocessing may also be unknown.

The embodiment may also be a timing control circuit for outputtingsubsignals having a variable number of pulses, and a verticalsynchronization signal having a variable generation cycle, to animage-capturing section for capturing a subject and starting thegenerating of image-capture data corresponding to a single frame insynchronization with the vertical synchronization signal, the subsignalsbeing generated a plurality of times within a period of one cycle of thevertical synchronization signal.

The procedures taught in the disclosure for varying the timing of thevertical synchronization signals applied to the image-capturing sectionmay be implemented as a program or method as well. A device, program, ormethod such as described above may be implemented as an independentdevice or by utilizing a shared component in a device having multiplefunctions, and various types of embodiments are included.

What is claimed is:
 1. A display-data processor comprising: a firstbuffer that stores image data corresponding to an Nth line of a display;a display data generator that generates display data corresponding tothe Nth line of the display based on the image data; a second bufferthat stores the display data corresponding to the Nth line of thedisplay; a timing signal generator that outputs a horizontalsynchronization signal corresponding to the Nth line of the displayafter the display data had been generated; and a display data outputcircuit that outputs the display data corresponding to the Nth line ofthe display within a horizontal synchronization period prescribed by thehorizontal synchronization signal corresponding to the Nth line of thedisplay after the horizontal synchronization signal corresponding to theNth line of the display had been outputted, wherein the horizontalsynchronization period is variable.
 2. The display-data processoraccording to claim 1, wherein the timing signal generator outputs avertical synchronization signal, and a vertical synchronization periodprescribed by the vertical synchronization period is variable.
 3. Animage-capturing device comprising the display-data processor accordingto claim 1, further comprising an image-capturing circuit that capturesan image of a subject and outputs the image data.
 4. An display devicecomprising the display-data processor to claim 1, further comprising thedisplay that displays the display data corresponding to the Nth line ofthe display.
 5. An image-capturing and display device comprising thedisplay-data processor according to claim 1, further comprising animage-capturing circuit that captures an image of a subject and outputsthe image data, and the display that displays the display datacorresponding to the Nth line of the display.
 6. A method of processinga display-data, the method comprising: storing image data correspondingto an Nth line of a display in a first buffer; generating display datacorresponding to the Nth line of the display based on the image data;storing the display data corresponding to the Nth line of the display ina second buffer; outputting a horizontal synchronization signalcorresponding to the Nth line of the display after the display data hadbeen generated; and outputting the display data from the second bufferto the display within a horizontal synchronization period prescribed bythe horizontal synchronization signal corresponding to the Nth line ofthe display after the horizontal synchronization signal corresponding tothe Nth line of the display had been outputted, wherein the horizontalsynchronization period is variable.